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SYSTEM AND METHOD FOR EFFICIENTLY PASSING 
INFORMATION BETWEEN COMPILER AND POST- 
COMPILE-TIME SOFTWARE 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The present invention is generally related to program 
optimization, and more particularly related to an apparatus and 
method for efficiently passing compiler information to post-compile- 
time software. 

DESCRIPTION OF RELATED ART 

As is known in the computer and software arts, when a software 
program is developed it will be optimized to run on a particular 
computer architecture. While it is possible that the software program 
developed for an original computer architecture will run on a 
computer system with a new or different architecture, the execution of 
the software program optimized for an old computer architecture will 
not generally run as quickly on a computer system with a new 
architecture, if at all. Therefore, devising a way to run an existing (i.e. 
old) architecture binary version of a computer program on a new 
architecture or improve the performance of the computer program on 
the existing architecture, is an important procedure. One such way to 
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improve the performance of a computer program is to utilize a post- 
compile- time dynamic optimizer. 

When software tools such as dynamic optimizer or profiling 
tools work on the binaries produced by the compiler, they face the 
challenge of analyzing low- level programs. It is desirable that some 
information can be passed from the compiler to the dynamic optimizer 
to make the analysis easier and more efficient. 

A good example is that when a dynamic optimizer generates 
code at run-time, it often needs to perform register liveness analysis of 
the binary code in order to find unused registers that can be used 
without altering the program behavior. Liveness of a register occurs 
when the register contains data that is to be utilized in subsequent 
processing. A register can switch between active usage of storing a 
value for later consumption (live), and an inactive state (dead). Since 
the compiler has already performed a liveness analysis, reusing this 
liveness information is just a matter of how to pass the information to 
the dynamic optimizer efficiently. 

Heretofore, software developers have lacked an apparatus and 
method for passing compile time information at run time to post- 
compile -time software in an efficient way. 
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SUMMARY OF THE INVENTION 

To achieve the advantages and novel features, the present 
invention is generally directed to a system and method for efficiently 
passing compiler information at run time to hardware or software in 
an efficient way. The present invention is particularly useful for 
efficiently passing compiler information during code optimization or 
translation utilizing free orunused operand fields of instructions such 
as NOP, and encoding the compile time information in the unused 
operand field. This technique removes the time overhead for 
analyzing binaries or low-level programs and does not increase 
program code size. 

The present invention provides a system and method for 
passing compile time information between a compiler and real-time 
operation of post-compile-time software. Briefly described, in 
architecture, the system can be implemented as follows. The 
preferred system of the present invention utilizes an unused NOP 
operand (a register usage bit vector) that is a vehicle (or 
communication channel) between a static compiler and a dynamic 
optimizer. Each bit in the vector represents a particular register and 
is used to indicate if the register may be live. The register usage bit 
vector in the unused NOP operand is used to make finding free 
registers easier during optimization. 
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The present invention can also be viewed as providing a method 
for passing compile time information between a compiler and real-time 
operation of post-compile- time software. In this regard, the method 
can be broadly summarized by the following steps: the compiler 
produces bit vectors for each basic block, (i.e., subroutine, function, 
and/ or procedure) and places the bit vector in the unused portion of 
the NOP instruction encoding. A bit in the vector represents a 
particular register. A bit is set if the register may be live at the 
location of the NOP instruction and allows the dynamic optimizer to 
determine if further analysis of the low-level code to determine 
whether the register is truly live is required. On the other hand, a 
zero (i.e., unset) bit in the bit vector signals that the compiler does not 
use the corresponding register (i.e., is a dead register) at the location 
of the NOP instruction, and therefore the register can be used by the 
dynamic optimizer. 

NOP instructions perform no operation and are generally used 
as filler or instruction place-holders. For example, NOP operations 
have an immediate operand that is not used. These operand fields 
provide an efficient one-way communication channel between the 
compiler and hardware or software. 

Because the compiler stores the dead register information in the 
unused operand area, the analysis information can be accessed 
without making the low-level code larger. Should the low-level code 
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not have a NOP instruction to encode register utilization information, 
the dynamic optimizer or other software can examine the operands of 
NOPs instructions in the surrounding basic blocks to deduce the 
missing information. A basic block is a collection of a sequence of 
instructions that are entered at the top of the sequence and exited at 
the bottom of the sequence. 

An advantage of deducing this missing information is that the 
information is particularly useful in improving performance of 
dynamic optimizations performed at runtime. This is because the 
analysis overhead directly reduces performance when performed. In 
the preferred method of the present invention, because the dynamic 
optimizations may inspect the unused NOP operands very quickly, the 
overhead is dramatically reduced to improve runtime performance. 

In another embodiment, the compiler may pass hints to profiler 
software of what kind of feedback information is desired through the 
use of the unused NOP operands. Because of many other possible 
uses of this communication channel, the compiler has to annotate the 
low-level code binaries it produces to indicate what information is 
contained in the unused NOP operands. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings incorporated in and forming a part 
of the specification illustrate several aspects of the present invention, 
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and together with the description, serve to explain the principles of 
the invention. In the drawings: 

FIG. 1 is a block diagram of a user system showing the compiler 
and dynamic optimizer of the present invention within the memory 
area. 

FIG. 2 A is a block diagram of a possible example of a bundled 
instruction, having three instructions grouped together in an X bit 
sized and aligned container. 

FIG. 2B is a block diagram of a possible example of a NOP 
instruction. 

FIGs. 3 A is a block diagram of the system of the present 
invention showing the interaction between the code register usage 
annotator and the system compiler to create a binary program code 
from the original source code. 

FIG. 3B is a block diagram of the system of the present 
invention showing the interaction between the binary program code, 
the dynamic optimizer, and the instruction vector comparator to 
create new optimized binary program code. 

FIG. 4 is a flow chart of the preferred method to perform the 
compilation process, as shown in FIG. 1 and utilizing a possible 
example of NOP instructions. 
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FIG. 5 is a flow chart of an example of the preferred method to 
perform the code register usage annotation process, as shown in FIG 
3A. 

FIG. 6 is a block diagram showing the bit vector generated for 
each basic block of the present invention utilizing a possible example 
of NOP instructions as shown in FIG. 2B. 

FIG. 7 is a flow chart of the preferred method to perform the 
dynamic optimization process of the present invention that utilizes the 
bit vectors to indicate register usage. 

FIG. 8 is a flow chart of the preferred method to perform the free 
register information process of the present invention that utilizes the 
bit vector to indicate register usage. 

FIG. 9 is a block diagram of a possible example 130 of 
utilization of the present invention with regard to multiple basic 
blocks and multiple registers. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Reference will now be made in detail to the description of the 
invention as illustrated in the drawings. Although the invention will 
be described in connection with these drawings, there is no intent to 
limit it to the embodiment or embodiments disclosed therein. On the 
contrary, the intent is to include all alternatives, modifications, and 
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equivalents included within the scope of the invention as defined by 
the appended claims. 

As illustrated in FIG. 1A, computer system 12 today generally 
comprises a processor 21 and memory 31 (e.g., RAM, ROM, hard disk, 
CD-ROM, etc.) including an operating system 32. The processor 21 
accepts binary program code 62 and data from the memory 3 1 over 
the local interface 23, for example, a bus(es). Direction from the user 
can be signaled by using input devices, for example but not limited to, 
a mouse 24 and a keyboard 25. The actions input and result output 
are displayed on the display terminal 26. 

Also shown is the compiler 60, binary program code 62, 
translated binary program code 130 and dynamic optimizer 100 in 
memory area 3 1 . These components and their operation are herein 
described in further detail with regard to FIGS. 4-9. 

Illustrated in FIG, 2 A is a block diagram of an example of three 
instructions that are grouped together in an X-bit sized and aligned 
container called a bundle 4 1 . Each bundle 4 1 contains three Y-bit 
instruction slots 42-44, a Z-bit template 45 and a stop bit fields. The 
stop bit field 46 specifies whether the instruction group boundary 
occurs after the last instruction of the current bundle 4 1 . Each of the 
instruction slots 42-44 includes an op code and necessary operands 
to execute one instruction. The template 45 specifies two properties: 
the instruction group boundaries within the current bundle 4 1 , and 
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the mapping of the instruction slots to execution unit types. Within a 
bundle 41, execution order proceeds from slot 0 to slot 2. 

The inventors have described an example of a specific 
instruction bundle format. However, the inventors contemplate that 
the present invention can be applied to system architectures that do 
not bundle instructions or bundle instructions in a different way from 
that disclosed above. 

Illustrated in FIG. 2B is an example of a possible instruction 
format for NOP instruction 50. As illustrated, the opcode bits 51 
occupy bits 40 through 37 of the possible NOP instruction. A reserved 
bit 52 occupies bit 36 of the possible instruction format for NOP 
instruction 50. Opcode extensions 53 occupy bits 35 through 27 of a 
possible instruction format for a NOP instruction 50. Unused bits 56 
occupy bits 26 through 6 of a possible instruction format for NOP 
instruction 50. This is where the register usage bit vector of the 
present invention is stored. Bits 5 through 0 are reserved bits 57. 
The inventors further contemplate that the present invention can be 
utilized with any system architecture, as long as there are unused bits 
in a NOP instruction 50, regardless of the particular instruction 
format. 

Illustrated in FIG. 3 A is a block diagram showing the interaction 
of the code register usage annotator 70, for the system compiler 60, 
and the created binary object code 62 of the present invention. The 
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original source code 6 1 is input into the system compiler 60 of the 
present invention. 

The system compiler 60 of the present invention includes the 
improvement that interacts with the code register usage annotator 70, 
for bit vector generation. This is done to assist the dynamic optimizer 
100 in the creation of the new optimized binary object code 130. The 
system compilation process 60 is herein defined in further detail with 
regard to FIG. 4. 

The code register usage annotator 70 generates bit vector 
annotation for each NOP instruction in the binary code based on 
register allocation results of the system compiler 60. The code 
register usage annotator 70 is herein defined in further detail with 
regard to FIG. 5. 

Illustrated in FIG. 3B is a block diagram illustrating the 
dynamic optimizer process of the present invention. As illustrated in 
FIG. 3B, the binary object code 62 generated by the system compiler 
60 of the present invention is input into the dynamic optimizer 100 of 
the present invention. 

The dynamic optimizer 100 interacts with the instruction bit 
vector comparator 120 for each NOP instruction in each basic block to 
generate the newly optimized binary object code 130. The instruction 
bit vector comparator 120 utilizes the bit vectors created in NOP 
instructions in each basic block by the code register usage annotator 

10 
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70 process. The dynamic optimizer process illustrated in FIG. 3B is 
herein defined in further detail with regard to FIGs. 7 and 8. 

Illustrated in FIG. 4 is the compilation process 60 of the present 
invention. First, the compilation process is initialized at step 61. 
Next, the compilation process 60 performs a lexical analyzer at step 
62. Then, a parser is executed at step 63. The parser is a process 
that processes the sequence of tokens and produces an intermediate 
level representation, such as a parse tree or sequential intermediate 
code and symbol table, that records the identifiers used in the 
program and/or attributes. The parser may produce error messages if 
the token strings contain syntax errors. 

The semantic analyzer operation is performed at step 64. The 
semantic analyzer is for checking a program for validity. This process 
takes the input of the intermediate code generated in the parsing step 
63 and a symbol table, and determines whether the program satisfies 
the schematic properties required by the source language, i.e., where 
the identifiers are consistently declared and used. The semantic 
analyzer step 64 may produce an error message if the program is 
semantically inconsistent or fails in some other way to satisfy the 
requirements of the programming language definitions. 

The register allocations are then performed at step 65. Then, 
the compilation process 60 performs the code generation process at 
step 66. Code generation utilizes the intermediate code generated in 
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the parser step 63 and semantic analyzer step 64 and transforms the 
code into equivalent machine code in a form of a relocatable object 
module or directly executable object code. Any detected errors may be 
warnings or definite errors and in the later case may terminate the 
compilation. 

Then, the code register usage annotation process of the present 
invention is performed at step 67. The code register usage annotation 
process is herein defined in further detail with regard to FIG. 5. 

Next, the compilation process performs the final assembly 
process at step 68. However, this step is optional since many 
compilers generate binary machine codes without requiring an 
assembly output. The compilation process 60 is then exited at step 
69. 

An alternative approach involves the code register usage 
annotation step 67. It is contemplated by the inventors that the 
compilation process 60 can inherit the register allocation information 
generated at step 65 and use this information since the compiler has 
determined what registers have been used and where the registers are 
used already. In this way, the compiler process 60 would not need to 
again scan the code to determine the register usage, as shown in FIG. 
5. 

Illustrated in FIG. 5 is a flow chart of the process for 
determining the code register usage annotation 70. The code register 
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usage annotation process 70 is first initialized at step 71. The code 
register usage annotation process 70 then gets the next basic block 
(i.e., subroutine, function, or procedure) for analysis at step 72. The 
code register usage annotation process 70 determines the registers 



Next, the code register usage annotation process 70 locates a 
NOP instruction in the basic block at step 74. At step 75, the code 
register usage annotation process 70 creates a register usage bit 
vector 80 in the unused area of the NOP instruction located at step 
74. The code register usage annotation process 70 sets all the bits in 
the NOP instruction register usage bit vector 80 corresponding to each 
caller-save register that is live at the location of the NOP instruction in 
the basic block at step 76. Liveness of a register occurs when the 
register contains data that is to be utilized in subsequent processing. 
A register can switch between active usage of storing a value (live) for 
later consumption, and an inactive state (dead). 

At step 77, the code register usage annotation process 70 
determines whether all NOP instructions in the basic block have been 
processed. If all NOP instructions in the basic block have not been 
processed at step 77, the code register usage annotation process 70 
then returns to repeat step 74 through 77. 

If the code register usage annotation process 70 has processed 
all NOP instructions in the basic block, the code register usage 



used in each basic block at step 73. 
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annotation process then in step 78, determines whether all the basic 
blocks have been processed for NOP instructions. If the code register 
usage annotation process 70 determine that all the basic blocks have 
not been processed, the code register usage annotation process 70 
returns to repeat step 72 through 78. If the code register usage 
annotation process 70 has processed all NOP instructions of all the 
basic blocks in the original source program 34 (FIG. 3A), the code 
register usage annotation process 70 exits at step 79. 

Illustrated in FIG. 6 is a block diagram representing an example 
of the structure of the code register bit vector 80 contained within the 
example of a NOP instruction's unused bit 56 ranging from 26 to 6. A 
total of 2 1 register usage bits of the example NOP instruction are 
available for register usage indication. The register usage bit vector 
80 comprises a plurality of register usage bits 81A through 81U. 
Each caller saved register has a corresponding usage bit within the 
register usage bit vector 80 contained within the NOP instruction's 
unused bits 56 ranging from 26 to 6. 

Illustrated in FIG. 7 is a flow chart of the dynamic optimizer 
process 100 of the present invention. First, the dynamic optimizer 
process 100 is initialized at step 101. The initialization process 100 
determines or finds all the source code entry points at step 102. The 
dynamic optimizer process 100 analyzes the binary object code 62 
from each entry point as determined in step 102, to ascertain all the 
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instructions and storage areas, including registers and memory 
locations utilized by the binary object code 62. 

At step 104, the dynamic optimizer process 100 performs the 
free register information process 110. The free register information 
process 1 10 is herein defined in further detail with regard to FIG. 8. 
After the free register information process 110 has been performed, 
the dynamic optimizer process 100 translates the created binary 
object code 62 into the new optimized binary object code 130 at step 
105. The dynamic optimizer process then exits at step 109. 

Illustrated in FIG. 8 is the flow chart for the free register 
information process 110. The free register information process 1 10 is 
first initialized at step 111. The free register information process 1 10 
retrieves all register usage bit vectors 80 in the affected NOP 
instructions, from all basic blocks within the binary object code 62 at 
step 112. For each NOP instruction, the register usage bit vector 80 
indicates the register usage at the location of the NOP instruction 
containing the register usage bit vector 80. The register usage bit 
vector 80 of the basic block containing the NOP instruction is deduced 
from the register usage bit vector 80, at step 113. A basic block is a 
collection of a sequence of instructions that are entered at the top of 
the sequence and exited at the bottom of the sequence. 

At step 114, the free register information process 110 
determines if optimization is to be performed across basic block 
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boundaries. If so, the free register information process 110 performs 
the bit-OR operation on the register usage bit vectors 80 of the 
affected basic blocks. This is done to determine which of the registers 
are not in use in any of the basic blocks. The free register information 
process 110 utilizes the register usage bit vectors 80 of the affected 
basic block instructions to optimize the binary object code 62 across 
basic block boundaries on-demand at step 115. Step 1 15 is not 
performed unless an optimization involves more than one basic block, 
and then only needs to logically "OR" the register usage bit vectors 80 
of the basic blocks involved in one optimization. 

If the free register information process 110 determines at step 
114 that it is not configured to optimize across basic block 
boundaries, the free register information process 110 proceeds to step 
1 16 to utilize the free registers available for optimization. After 
utilizing the free registers available for optimization, the free register 
information process 110 exits at step 119. 

Illustrated in FIG. 9 is a block diagram of a possible example 
130 of the utilization of the present invention with regard to 4 basic 
blocks (131-134) and the register usage of registers R2, R3 and R4. 
As shown in basic block 131, a NOP instruction is encountered and 
encoded prior to the loading of any registers. Therefore, the NOP 
instruction is encoded in the register usage bit vector 80 to reflect that 
all registers are dead. Basic block 131 contains code that loads data 
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into registers R2 and R3 and then jumps to basic block 132 or basic 
block 133 for further processing. 

Basic block 1 32 contains code that utilizes register R2 and 
causes register R2 to change status from live to dead. The NOP 
instruction in basic block 132 is encoded to reflect that registers R2 
and R4 are dead, and that register R3 is live. This indicates that the 
contents of register R2 were consumed. 

As shown in basic block 133, a NOP instruction is encountered 
and encoded prior to the processing of any registers. The NOP 
instruction in basic block 133 is encoded to reflect that registers R2 
and R3 are live and that register R4 is dead. 

Basic block 134 contains code that loads registers R2 and R4 
and causes a change of state for registers R2 and R4 from dead to live. 
Basic block 134 further contains code that utilizes data in register 
R3. The NOP instruction in basic block 134 is encoded to reflect that 
R2 and R4 are live, and that R3 is dead. 

The optimization using unused operands in the NOP instruction 
system comprises an ordered listing of executable instructions for 
implementing logical functions, can be embodied in any computer- 
readable medium for use by or in connection with an instruction 
execution system, apparatus, or device, such as a computer-based 
system, processor-containing system, or other system that can fetch 
the instructions from the instruction execution system, apparatus, or 
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device and execute the instructions. In the context of this document, 
a "computer- readable medium" can be any means that can contain, 
store, communicate, propagate, or transport the program for use by or 
in connection with the instruction execution system, apparatus, or 
device. 

The computer readable medium can be, for example but not 
limited to, an electronic, magnetic, optical, electromagnetic, infrared, 
or semiconductor system, apparatus, device, or propagation medium. 
More specific examples (a nonexhaustive list) of the computer- 
readable medium would include the following: an electrical 
connection (electronic) having one or more wires, a portable computer 
diskette (magnetic), a random access memory (RAM) (magnetic), a 
read-only memory (ROM) (magnetic), an erasable programmable read- 
only memory (EPROM or Flash memory) (magnetic), an optical fiber 
(optical), and a portable compact disc read-only memory (CDROM) 
(optical) . 

Note that the computer-readable medium could even be paper 
or another suitable medium upon which the program is printed, as 
the program can be electronically captured, via for instance, optical 
scanning of the paper or other medium, then compiled, interpreted or 
otherwise processed in a suitable manner if necessary, and then 
stored in a computer memory. 
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The foregoing description has been presented for purposes of 
illustration and description. It is not intended to be exhaustive or to 
limit the invention to the precise forms disclosed. Obvious 
modifications or variations are possible in light of the above teachings. 
The flow charts of the present invention show the architecture, 
functionality, and operation of a possible implementation of the 
register usage optimization compilation and translation system. In 
this regard, each block represents a module, segment, or portion of 
code, which comprises one or more executable instructions for 
implementing the specified logical function(s). It should also be noted 
that in some alternative implementations, the functions noted in the 
blocks may occur out of the order noted in the figures, or for example, 
may in fact be executed substantially concurrently or in the reverse 
order, depending upon the functionality involved. 

The embodiment or embodiments discussed were chosen and 
described to provide the best illustration of the principles of the 
invention and its practical application to enable one of ordinary skill 
in the art to utilize the invention in various embodiments and with 
various modifications as are suited to the particular use 
contemplated. All such modifications and variations are within the 
scope of the invention as determined by the appended claims when 
interpreted in accordance with the breadth to which they are fairly 
and legally entitled. 



